In April, Snap Inc. introduced the My AI feature for its photo-sharing platform, Snapchat. This feature, powered by OpenAI's technology, enables conversations between Snapchat users and the ChatGPT-powered AI. However, there are growing concerns that this feature might face a ban in the UK due to potential privacy risks, particularly concerning children.

One of the main concerns regarding this feature is the possibility of it jeopardizing the privacy and safety of children who use the platform. Additionally, some Snapchat users have expressed dissatisfaction with the ChatGPT integration, as it remains prominently displayed at the top of their chats, possibly leading to a less desirable user experience.

Why the UK may ban Snapchat’s My AI feature

The Information Commissioner's Office (ICO), the privacy regulator in the UK, has issued a warning to Snapchat. In a blog post, the ICO expressed concern that Snapchat may not have conducted a thorough risk assessment regarding child privacy. This suggests that the company might not have adequately addressed the potential privacy risks associated with its My AI feature, especially when it comes to the protection of children's privacy.

The Information Commissioner's Office (ICO) has made a provisional finding that Snap failed to adequately identify and assess the risks associated with its 'My AI' feature, which is used by several million users in the UK, including children aged 13 to 17. The ICO's investigation indicates that the risk assessment conducted by Snap before the launch of 'My AI' did not sufficiently evaluate the data protection risks associated with generative AI technology, especially concerning minors. Given the innovative nature of this technology and the processing of personal data from 13 to 17-year-old children, the assessment of data protection risks is deemed crucial.

It's important to note that this finding is provisional, and Snap has the opportunity to contest and prove the regulator wrong. However, if Snap fails to do so, the UK may potentially ban the 'My AI' feature. In such a scenario, Snap may be required to cease data processing related to 'My AI' in the UK, which would mean suspending the offering of the 'My AI' product to users in the UK until an adequate risk assessment is conducted, as highlighted by the ICO.

Snapchat earlier warned users about ChatGPT

When integrating ChatGPT into Snapchat, the company issued a cautionary note to its users, advising them against sharing confidential information with the AI. Snap explicitly stated that the conversations users have with the chatbot will not remain private.

Snap's message to users included the following warning: "All conversations with My AI will be stored and may be reviewed to enhance the product experience. Please refrain from sharing any confidential information with My AI and avoid relying on it for advice." This statement underscores the importance of user discretion and emphasizes that interactions with the AI may be subject to review for product improvement purposes.